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of Correbuon 

' REQUEST FOR CERTIFICATE OF CORRECTION 
PURSUANT TO 37 CFR 1.322 AND 37 CFR 1.322 

Attention: Certificate of Correction Branch 

Commissioner for Patents 

P.O. Box 1450 

Alexandria, VA 22313-1450 

Dear Sir: 

Upon reviewing the above-identified patent. Patentee noted several Patent Office errors 
which should be corrected. 

The following errors were not in the application as filed by applicant: 

In the Application: 

First Page Col. 2 (Abstract), Line 17, Delete "longed" and insert - - logged - -. g 
i" •'. -^8 



Column 2, Line 12, (Approx.), After "6,125,236" delete "," and insert 
Column 2, Line 15, (Approx.), After "5,875,446" delete "," and insert 
Column 2, Line 29, (Approx.), After "1993" delete "," and insert 



in ^ 
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Application No, : 1 0/063,4 1 3 2 Docket No. : 08228/1 203278-US4 

Column 2, Line 51, (Approx.), After "task" delete and insert 
Column 2, Line 5 1 (Approx.), Delete "it" and insert - It 

Column 8, Line 17, (Approx.) Delete "Natural Language Search Incorporates:" and 
insert Natural language search incorporates:--. 

Column 13, Line 46, (Approx.) Delete "WYS/WYG" and insert -- WYSIWYG -. 

Column 13, Line 66, After "platform" delete "37". 

Column 13, Line 66, Insert -"-- before "helper". 

Column 14, Line 52 (Approx.) Below "a PDA version:" insert - [tl] ~. 

Enclosed please find marked up copies of page 2 of the Abstract, pages 3, 12, 21 & 23 of 
the Specification. 

The following errors were found in the application as filed by applicant. The errors now 
sought to be corected are inadvertent typographical errors, the correction of which does not involve 
new matter or require reexamination. 

Column 9, Line 40 (Approx.), After "try" delete ":"and insert 

Column 9, Line 44 (Approx.), After "try" delete ":" and insert 

Column 12, Line 37 (Approx.), Delete "lowestterm" and insert - lowest term 

Column 12, Line 49 (Approx.), Delete "then" before "uses". 

Transmitted herewith is a proposed Certificate of Correction effecting such amendment. 
Patentee respectfully solicits the granting of the requested Certificate of Correction. 
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The Commissioner is authorized to charge any deficiency of up to $300.00 or credit any 
excess in this fee to Deposit Account No. 04-0100. Enclosed please find a check for $100.00. 



Dated: November , 2005 Respectfully submitted, 




Flyrm Barrison 
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DARBY & DARBY P.C. 
P.O. Box 5257 

New York, New York 1 0 1 50-5257 
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Attorneys/Agents For Applicant 
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6,944.611 
10/063,413 
September 13. 2005 
Sharon Flank et al. 



It is certified that an error appears or errors appear in the above-identified patent and 
that said Letters Patent is hereby corrected as shown below: 

In the Application: 

First Page Col. 2 (Abstract), Line 17, Delete "longed" and insert - - logged - 
Column 2, Line 12, (Approx.), After "6,125,236" delete and insert 
Column 2, Line 15, (Approx.), After "5,875,446" delete "," and insert 
Column 2, Line 29, (Approx.), After "1993" delete "," and insert 



Column 2, Line 51, (Approx.), After "task" delete "," and insert 

Column 2, Line 5 1 (Approx.), Delete "it" and insert t- It --. 

Column 8, Line 17, (Approx.) Delete "Natural Language Search Incorporates:" and 
insert - Natural language search incorporates:-. 
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Column 9, Line 40 (Approx.), After "try" delete ":"and insert 

Column 9, Line 44 (Approx.), After "try" delete ":" and insert 

Column 12, Line 37 (Approx.), Delete "lowestterm" and insert - lowest term 

Column 12, Line 49 (Approx.), Delete "then" before "uses". 

Column 13, Line 46, (Approx.) Delete "WYS/WYG" and insert WYSIWYG 

Column 13, Line 66, After "platform" delete "37". 

Column 13, Line 66, Insert -"- before "helper". 

Column 14, Line 52 (Approx.) Below "a PDA version:" insert - [tl] 
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Amend the Abstract as follows 

A system stores digital media tecoids and has a seaich entdne searching the stoied digital 
media records. Tlie system receives first search leouests ftom a plurality of first ti^, 
The system pq jfm ff ft. hy the search engine, searohes based upon the first searoh requests, 
yielding respect ive first search results, each first search result defining first selected 
digital media records. The first search resul ts are logged. Information is received fiom 
the first users indicative of subsequent actions bv the first users selecting particular ones 
of the selected dipital media records. A second search request is received fi'om a second 
user. A search is performed, bv the search engine, based upon the second search request, 
yielding respective second search results, the second search results defininp.second 
selected digital media records. The second selected media records are then ranked 
differently, for example upward or downward, based upon the|^^d|irst search results. 
The floftworo aoeording to the invention inQorpomtos a gloaaary management tool that 
malcoo it easy for oooh olicht to ouatomige ttyminology totho nccda of a portioulor 
buflinoaa. With diio tool, teirmcd a glossary manager, a company oon customige a number 
of feature nomoa in the oyotem to provide a more familiar oontoxt for their uaerp. A . 
oystom odminiotnitor oon alao ouatomiec the manner in which "thumbnail" or "proviow*' 
imogco ore preaontod Tho aystem pcrforma eluatering on ooaroh queries, and oooroheo 
media records multi modolly, using two or more opproaohea aueh as imago ooarohing and 
tcxtooorohing. An adminiatrotoT con tune ooaroh paramotaro. Twoormoreatreamaof 
m e tadata may bo olignod ond oorrolated with a medio file, faoilitoting later oonrehing. 
Tho ayatom ovaluatca itaolf. It - folda populori^ information into ranldngo of ooaroh 

IVUIUU. 
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Pat. Nos. 5,251 .316 an(y 6.1 25.236. P ast approaches for searching multimedia include 
U.S. Pat. Nos. 6,243,71 3 and 5,794,249. 

[0007] Clustering Is well known, for example in U.S. Pat. No. 5,31 7,507, 5,758,257, 

5,675.819, 5,778,362, and |5.875.446^ ee also Buckley, Chris. J. Walz, M. Mitra and C. 
Cardie, 'Using Clustering and Super Concepts within SMART: TREC 
6" (http://trec.nist.gov/pubs/trec6/t6_proceedings.html); Zamir, Oren, 0. Etzioni, 
Madani. and Karp, KDD "Fast And Intuitive Clustering Of Web Documents;" and Koller, 
Daphne, and Mehran Sahami. ML "Hierarchically Classifying Documents Using Very 
Few Words." Rankings relating to relevance are discussed in U.S. Pat. No. 5,642,502. 



»•?%. 
ill? 

^1^ field in the early '90s. and was strongly advanced by the TREC evaluations designed at 

III 



[0008] The evaluation of information retrieval systems became an essential part of the 



NIST beginning i n|l993.^ he TREC evaluation contains different tracks, but the tracks 
all share the following common features: 



} [0009] • They are designed to provide a comparative evaluation between different 
,^|^ systems, usually provided by different participants. 



[0010] • The evaluation is done using strict test conditions that contain a set of queries, a 
colleaion of documents, and relevance judgements. 

[001 1} • The evaluations use evaluation scores such as precision and recall that 
supposedly predict real users' satisfaction from a system. 

[001 2] While these evaluations are indeed helpful in comparing the performance of 

different IR systems, they do not provide constant feedback on the performance of a 
live IR system. The base performance of an IR system could be at first evaluated using 
a standard measurement such as the one above, but as more media files are added to 
a system and users submit queries in an uncontrolled manner, it is hard to predict or 
estimate the performance of the system. In addition, if the system does not fall into 
the initial TREC evaluation tracks, it^is necessary to develop an independent test case 



— a very costly task. It lis desirable to have a better self-evaluation system for such a 



[00131 



digital asset manager. 

Known annotation-related systems are discussed In U.S. Pat. No. 5,600,775. 
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vocabulary lists and be sure not to deviate. Sometimes tools can be built to aid m this 
process, depending on the size of the controlled vocabulary. Similarly, tools can also 
be provided to searchers to control their search requests. However, controlled 
vocabulary systems do not scale beyond a few thousand terms, since it is impractical 
to look up every word in English for every search. For broader retrieval systems, for 
faster cataloguing, and for simpler searching, a different approach is superior. 

[00551 in addition to standard keyword and Boolean searching, the system software 
incorporates additional advanced technology for locating stored files. Rather than 
limiting searching to a controlled vocabulary, the system software includes natural 
language search, which allows cataloguers and users to employ any words in English 
h (or whatever natural language the retrieval system is using). 

^ [00561 ^jNatural languagesear^^ I 
[00571 • a semantic network of concepts 



Hi 



[00581 • additional linguistic techniques, including: 



p.t [00591 • phrase matching 

[00601 • derivational morphology, In lieu of stemming 
[00611 • part of speech tagging 
[00621 • name recognition . 
[00631 • location recognition 

[00641 User-mable Search Parameters. The system according to the invention provides a 
screen for customers to adjust search parameters, to reflect their company use of 
stored media file collections. This is shown in Fig. 3. While the parameters may 
themselves be well-known in a searching system, what is emphasized here is that the 
user (or. more likely, an administrator) can be granted access to such fundamental 
decisions about search as: 
[00651 (a) how good a match has to be before it Is displayed to the user. e.g. 50%. and 
[00661 (b) how "creative- the search should be. i.e. how much should the search terms be 
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annotations, or mark-ups, of full motion digital still images, video trames, or other 
indexed data structures. The viewer, preferably accessible on a personal computer 
with a Web browser, serves as a helper application for the underlying application of 
the system according to the Invention. The viewer allows users to view and mark up 
(comment on) media on a separate, see-through lightweight layer. The viewer 
supports annotations that are created and rendered so that they appear overlaid on 
the related media. Position, size, frame number, and other attributes of annotations 
are saved in a separate annotation file, and when played back the annotations appear 
at the saved location and with the saved attributes. Preferably, to the greatest extent 
possible, creating and editing of annotations is be done ir f WYSIWYG what you see is 
what you get) fashion. This is Illustrated In Fig. 5. 



IjI [01 25] The annotations may consist of text, graphics, and digitized audio, and are stored 

separately from the original file information. An indexing scheme relates individual 
Ml annotations to Individual video frames. On full motion video playback, the annotations 

are displayed on the originally annotated frames. One central part of the system 

15. 

according to the invention is the use of a downloadable, view-only application, which 



rii 
m 



enables users who do not have the full power to create annotations nonetheless to be 
able to view annotations created by others. 

(01 26] In an exemplary embodiment, files are stored centrally. Preferably the viewer 
provides security, e.g. SSL, server authentication, and proxy authentication. The 
underlying application according to the invention powers the full lifecycle of digital 
media from content collaboration, deep storage, search and retrieval using a natural 
language search and the ability effectively to move bandwidth-intensive media over 
the Web. The software Is preferably Web-based. 



[01 27] The viewer Is a standalone(platform"helper"<ipplication that is normally launched 



by a Web browser, from a specific link on a Web page that is part of the Web server of 
the system according to the invention. The viewer has the ability to upload annotation 
data back to the Web server. Except for the two actions of launching and uploading, 
the viewer does not require any network connection with the Web server or the Web 
browser. 



10 1 Z8J jf^g current viewer In the system according to the invention on a PC or Macintosh 
APPJD=10063413 Page 21 of 38 
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[0141] PDA (or handheld Oi wearable) version of the viewer builds on tht: same general 
architeaure. The server generates a simple XMl annotations file, sends it to the client 
(i.e. the viewer via the Web browser), and handles the returned HTTP messages from 
the viewer. 

(01 42] The following annotation types are desirably supported on a PDA version: 

© .' 

Annotation types 



Type 


Attributes 


Freehand drawing 
(pen) 


Line width, Color 


Transparent text 


Font name, Font size, Font coior 


Sticky note 


Font name, Font size, Font color, Baclcground 
color 


Sound 


Audio data 



[01 43] In this way, the system according to the invention supports the full life cycle of 

media; allowing organizations to expedite the process of searching, collaborating and 
distributing of digital assets, such as imagery, video files, pictures and text 
documents, lisers desirably have the freedom to collaborate anywhere at anytime 
using the annotation viewer according to the invention on a PDA. Users are preferably 
able to annotate video and still images with a virtual pen, sticky note, text and even 
voice using a wireless modem. Annotations are preferably capable of being added, 
edited, moved, or deleted. 

[01 44] A PDA-based digital media management solution takes digital delivery and 

collaboration to the next level by eliminating the need of a traditional PC and Ethernet 
connection. In addition, users no longer need to carry laptops to stay up to date on 
work involving video or still images. 

[01 45] Preferably the viewer supports both HTTP authentication and Proxy authentication. 
As an option, the viewer displays a login dialog where the user can enter a user ID and 
password to be used for authentication. Since the viewer is activated and closed 
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